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Environmental  indicators  have  been  constructed  and  used  as  a  tool  for  measuring  environmental  perfor¬ 
mance  for  various  purposes  in  the  industrial  environment  including  that  of  decision-making.  However, 
few  studies  in  the  literature  address  the  issue  of  the  quality  of  the  data  used  for  the  construction  of  these 
indicators,  and  one  of  the  factors  neglected  is  the  uncertainty  associated  with  them.  This  paper  deals 
with  a  case  study  on  the  uncertainty  in  the  energy  indicators  of  a  petrochemical  industry  in  Brazil.  In  this 
study,  there  is  an  examination  of  the  components  involved  in  making  the  calculation  of  energy  indicators, 
as  well  as  their  uncertainties.  The  end  result  is  the  development  of  a  methodology  that  can  be  used  for 
assessing  the  uncertainty  of  the  indicators.  The  evaluation  of  this  uncertainty  shows  a  value  greater  than 
appropriate  for  the  intended  use  of  the  indicator.  In  order  to  reduce  this  uncertainty,  an  attempt  has  been 
made  to  point  out  the  most  striking  features  that  require  investment  in  human  and  economic  resources, 
such  as  improvement  in  the  measurements  and  implementation  of  new  measurers  at  critical  points. 
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1.  Introduction 

Many  organizations  are  seeking  ways  to  understand,  demon¬ 
strate,  improve  and  measure  their  environmental  performance  [1  ]. 
According  to  the  ISO  1 403 1 ,  this  can  be  achieved  effectively  by  deal¬ 
ing  with  the  features  of  its  activities,  such  as  products  and  services 
which  have  a  significant  impact  on  the  environment.  This  impact 
can  be  measured  through  related  indicators,  such  as  the  amount  of 
energy  consumed  in  manufacturing  the  products.  With  regard  to 
industrial  activities,  the  indicators  were  traditionally  related  to  eco¬ 
nomic  factors,  such  as  cost,  production  and  process  efficiency,  while 
failing  to  focus  on  environmental  areas  [2].  However,  the  efficient 
use  of  water  and  energy  for  their  industrial  units  has  led  the  indus¬ 
try  to  change  its  attitudes  to  already  established  schemes  which, 
due  to  their  operational  success  in  terms  of  the  need  to  optimize 
the  use  of  natural  resources,  had  not  been  questioned  before  [3]. 

Environmental  performance  can  be  defined  as  the  "measurable 
results  of  the  ability  of  an  organization  to  handle  environmental  factors 
which  can  be,  defined  as  those  elements  of  an  organization’s  activi¬ 
ties,  products  or  services  that  can  interact  with  the  environment,  and 
have  an  impact  on  it”  [4].  Environmental  performance  evaluation 
(EPE)  is  a  process  of  internal  management  designed  to  facilitate 
decision-making,  by  making  a  selection  of  indicators  to  provide 
information  for  comparing  the  environmental  performance  of  the 
past  and  present,  and  thus  predict  the  possible  trends  in  the  future 
of  an  organization. 

The  need  for  information  about  organizational  performance 
has  arisen  for  several  reasons:  compliance  cost  reduction  regard¬ 
ing  future  requirements,  the  adoption  of  voluntary  environmental 
codes,  lower  operating  costs,  improved  relations  with  stakehold¬ 
ers,  and  finally,  an  awareness  of  the  environmental  visibility  of 
the  company  as  a  competitive  advantage  [3].  The  indicators  can 
be  used  as  an  important  measurement  tool  to  display  this  informa¬ 
tion  in  a  clear  and  objective  way,  to  help  meet  these  requirements 
[5].  As  such,  the  indicators  are  the  main  tools  of  the  ISO  14031 
for  providing  information  about  the  environmental  performance 
of  organizations  [6-16].  Lately,  environmental  indicators  have  thus 
been  constructed  and  used  as  a  tool  to  support  environmental  man¬ 
agement  organizations  [9,17-19,13,20].  One  factor  that  is  often 
neglected  is  the  uncertainty  of  the  measurements  applied  to  the 
indicators,  as  well  as  the  raw  data  used  for  their  construction 
[21,19].  However,  Perotto  et  al.  [19]  state  that  the  uncertainty  has 
affected  the  raw  data  and  this  is  a  crucial  issue,  since  the  indica¬ 
tors  may  provide  a  distorted  image  of  the  results  when  applied  to 
environmental  factors. 

This  article  sets  out  a  methodology  for  calculating  the  energy 
indicators  and  estimates  of  uncertainty.  The  proposed  methodology 
is  based  on  the  method  outlined  by  GUM  Guide  to  the  expres¬ 
sion  of  uncertainty  in  measurement  published  by  the  International 
Organization  for  Standardization  ISO  (GUM  [22]).  This  methodol¬ 
ogy  was  used  to  examine  a  large  petrochemical  industry  located 
in  the  Industrial  Complex  of  Camaari,  in  Bahia,  Brazil.  The  results 
tend  to  support  the  company’s  strategic  decisions  with  regard  to 
the  calculation  of  indicator  values. 

2.  Indicators 

There  are  several  definitions  and  characteristics  of  indicators 
that  can  be  found  in  the  literature.  According  to  Perotto  et  al.[19], 
indicators  are  variables  that  summarize  or  simplify  relevant  infor¬ 
mation  about  the  state  of  a  complex  system.  Cantarino  [23]  defines 
indicators  as  useful  information  for  decision-making,  which  means 
that  one  can  infer  the  quality  of  a  particular  indicator  by  the 
quality  of  the  information  provided.  According  to  Cardoso  [4], 
indicators  can  be  used  as  an  important  measurement  tool  to 
express  information,  clearly  and  objectively,  and  thus  help  meet 


this  demand.  They  are  management  control  tools  that  provide 
support  for  decision-making  which  are  based  on  the  relevant  infor¬ 
mation  and  summarized  in  concise  illustrative  statements.  The 
indicator  can  be  considered  a  variable  an  operational  representa¬ 
tion  of  an  attribute  (quality,  characteristic,  property)  of  a  system 
[24].  It  is  usually  calculated  on  the  basis  of  historical  observa¬ 
tions  and  reflects  past  behavior;  this  enables  indicators  to  be 
used  in  the  detection  of  trends,  benchmarking  and  reporting  on 
operational  conformity  with  regard  to  any  restrictions  imposed 
and  the  achievement  of  best  practices  in  environmental  manage¬ 
ment. 

Indicators  can  provide  either  qualitative  or  quantitative  infor¬ 
mation.  Both  are  necessary  and  a  complementary  means  of  showing 
the  environmental,  economic  and  social  performance  of  the  orga¬ 
nizations.  Although  the  use  of  quantitative  indicators  is  highly 
recommended,  it  is  not  always  possible  to  apply  them  to  mea¬ 
sure  performance,  especially  in  the  social  field.  Many  social  issues 
are  subjective  and  the  measurement  of  performance  is  not  easily 
quantifiable  [25],  Quantitative  indicators  are  well-defined  compo¬ 
nents  and  are  thus  more  easily  reproduced  over  time  and  have 
greater  reliability  in  their  information,  while  qualitative  indicators 
are  more  susceptible  to  variations. 

According  to  Veleva  and  Ellenbecker  [24]  constructing  an 
indicator  involves  adding  a  unit  of  measurement,  the  period  of  mea¬ 
surement,  and  boundaries.  Environmental  indicators  can  be  shown 
in  either  absolute  or  relative  terms,  for  example,  as  an  expression 
that  provides  information  that  can  be  used  to  compare  an  organiza¬ 
tion’s  environmental  performance  with  its  production.  As  well  as 
these  two  forms  of  presentation,  the  standard  [23,26,1,10,27,24]. 
As  well  as  these  two  forms  of  presentation,  the  standard  [28]  pro¬ 
vides  three  examples  of  ways  that  environmental  indicators  can  be 
classified: 

•  Indexed  -  data  or  descriptive  information  converted  into  units  or 
in  a  form  that  links  the  information  to  a  chosen  standard  or  frame 
of  reference  that  is  expressed  in  percentage  (%)  terms. 

•  Aggregate  -  data  or  descriptive  information  of  the  same  type  but 
collected  from  different  sources  and  expressed  as  a  combined 
value,  thus  providing  one  or  more  environmental  parameters  of 
interest. 

•  Weighted  -  expresses  the  degree  of  relative  importance  or  impor¬ 
tance  of  the  indicators  of  environmental  performance. 

Hence,  the  use  of  indicators  is  a  part  of  an  ongoing  evolutionary 
process  that  involves  obtaining  knowledge  and  requires  a  survey, 
analysis  and  interpretation  of  the  data  and  processes.  This  can  lead 
to  transformation  in  the  company  by  raising  awareness  and  enter¬ 
ing  a  more  worthwhile  dialogue  with  stakeholders  [24].  When 
collecting  data  that  will  supply  the  indicators  with  information, 
it  is  necessary  to  take  into  account  its  reliability,  availability  and 
validation  in  both  phenomenological  and  statistical  areas. 

2.1.  Environmental  indicators  and  environmental  performance 
indicators 

A  number  of  definitions  of  environmental  indicators  have  been 
cited  by  different  organizations.  In  the  case  of  EPA  (2003)  the 
North  American  Environmental  Protection  Agency,  an  environmen¬ 
tal  indicator  is  a  numerical  value  derived  from  actual  measurements 
of  a  pressure,  state  or  ambient  condition,  exposure  or  human  health  or 
ecological  condition  over  a  specified  geographic  domain,  whose  trends 
over  time  represent  or  draw  attention  to  underlying  trends  in  the  con¬ 
dition  of  the  environment  [29].  UNEP  (2009)  the  United  Nations 
Environment  Programme  defines  environmental  indicators  as  a 
way  to  improve  the  delivery  of  information  for  decision-making  [30]. 
While  for  the  Organization  for  Economic  Cooperation  and  Devel- 
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opment,  it  is  an  essential  tool  for  tracking  environmental  progress, 
supporting  policy  evaluation  and  informing  the  public  [31]. 

In  the  case  of  an  industrial  environment,  environmental  indica¬ 
tors  are  important  tools  for  measuring  and  displaying  the  results 
that  enable  life  cycle  assessment  of  the  product  to  be  made  [32]  This 
can  help  industry  to  obtain  optimal  operating  points  with  regard 
to  its  environmental  performance  and  support  advances  made  in 
industry  by  taking  action  that  can  lead  to  effective  improvements 
in  sustainability.  Looking  at  the  issue  in  greater  detail,  according 
to  Jasch  [10]  and  Tsoulfas  and  Pappas  [33],  environmental  perfor¬ 
mance  indicators  can  be  used  in  the  following  ways: 

•  Highlighting  the  potential  for  optimization. 

•  Achieving  the  environmental  objectives  of  the  company. 

•  Identifying  market  opportunities  and  the  scope  for  cost  reduc¬ 
tion. 

•  Evaluating  the  environmental  performance  of  different  compa¬ 
nies  (benchmarking). 

•  Acting  as  a  communication  tool  for  environmental  reporting. 

•  Providing  technical  support  for  environmental  management  sys¬ 
tems. 

A  further  feature  of  the  indicators  is  that  they: 

•  Should  be  measurable,  and  thus  verifiable. 

•  Should  help  improve  the  decision-making  process,  after  carrying 
out  an  overall  assessment  of  a  company’s  operations,  products 
and  services. 

•  Should  also  enhance  benchmarking  and  monitoring  over  time, 
since  companies  have  to  modify  their  practices  from  time  to  time. 

Tsoulfas  and  Pappis  [33]  highlight  two  difficulties  that  have  been 
encountered  with  the  construction  and  use  of  environmental  per¬ 
formance  indicators.  The  first  is  the  collection  of  data,  especially 
when  large  systems  are  being  examined,  and  the  second  is  lack  of 
data  quality,  leading  to  different  approaches  being  adopted  and  a 
feeling  that  they  do  not  produce  a  true  and  fair  account  of  a  process. 

2.2.  ISO  1 403 1 

This  standard  describes  two  general  categories  of  indicators  for 
environmental  performance  evaluation  (EPE). 

2.2.1.  Environmental  performance  indicators  (EPIs). 

EPIs  can  be  classified  as: 

•  Management  Performance  Indicators  (MPIs):  these  are  types  of 
EPIs  that  provide  information  on  the  efforts  made  by  the  man¬ 
agement  to  influence  the  environmental  performance  of  the 
organization's  operations. 

•  Operational  Performance  Indicators  (OPIs):  these  are  types  of  EPIs 
that  provide  information  about  the  environmental  performance 
of  the  organization’s  operations. 

2.2.2.  Environmental  condition  indicators  (ECIs) 

ECIs  provide  information  that  can  help  the  organization  to  have 
a  better  understanding  of  the  impact  or  potential  impact  of  its 
environmental  policies  and  thus  help  in  the  planning  and  imple¬ 
mentation  of  the  EPE.  Table  1  shows  some  examples  of  indicators 
used  for  assessing  the  environmental  performance  found  in  stan¬ 
dard  ISO  14031. 


Table  1 

Examples  of  indicators  for  EPE  (ISO  14031). 


Category 

Classification 

Examples 

EPIs 

MPIs 

Operating  and  capital  costs  associated  with  the 
environmental  aspects  of  a  process  or  product 
Return  on  investment  in  environmental 
improvement  projects 

Number  of  objectives  and  targets 
environmentally  achieved 

OPIs 

Quantity  of  energy  used  per  year  or  per  unit  of 
product 

Quantity  of  water  reused 

Quantity  of  water  per  unit  of  product 

ECIs 

ECIs 

Concentration  for  monitoring  of  a  given 
contaminant,  in  air,  at  selected  sites 

Dissolved  oxygen  in  receiving  bodies 
Concentration  of  selected  nutrients  in  the  soil 
adjacent  to  the  premises  of  the  industry 

3.  Initiatives  taken  in  the  use  of  environmental 
performance  indicators  for  EPE 

Diakaki  et  al.  [7]  recommends  a  method  based  on  the  principles 
of  risk  assessment  (a  basic  technique  in  environmental  protec¬ 
tion  and  management),  to  assist  organizations  in  selecting  the 
most  appropriate  indicators  for  the  assessment  procedures  of  their 
environmental  performance.  The  main  advantage  of  applying  this 
method  is  that  it  makes  it  easier  to  carry  out  an  evaluation  of  envi¬ 
ronmental  performance  by  putting  emphasis  on  one  of  the  most 
important  steps  required  to  decide  what  specific  indicators  should 
be  taken  into  account.  Hermann  et  al.  [9]  use  a  combination  of  three 
tools  (LCA  -  analysis  of  the  life  cycle,  MCA  -  multi-criteria  analy¬ 
sis  and  EPIs  -  environmental  performance  indicators)  to  provide 
information  about  the  evaluation  of  environmental  impacts  applied 
in  improving  the  environmental  performance  of  an  pulp  industry 
in  Thailand.  Integrating  these  three  tools  allows  for  an  assess¬ 
ment  which  is  complete  in  that  it  includes  parts  of  the  production 
chain  that  are  outside  the  boundaries  of  the  industrial  system  itself, 
resulting  in  indicators  which  are  easy  to  interpret  for  policy  pur¬ 
poses  with  readily  available  information.  From  a  methodological 
point  of  view,  a  disadvantage  of  this  new  combination  of  tools  may 
be  the  fact  that  the  LCA  is  not  fully  carried  out.  However,  a  full  LCA 
may  not  be  needed  for  companies  that  are  primarily  interested  in 
the  part  of  the  system  they  control,  i.e.  the  on-site  processes  as  well 
as  the  preceding  production  chain  on  which  they  have  influence 
through  their  choice  of  suppliers.  Saengsupavanich  et  al.[13]  used 
environmental  performance  indicators  to  assess  the  environmental 
performance  of  the  Industrial  Estate  Authority  of  Thailand  (IEAT)  as 
a  means  of  regulating  the  Map  Ta  Phut  (MTP)  port  and  industrial 
estate.  Johnston  and  Smith  [11]  put  forward  a  model  based  on  two 
methods  to  devise  indicators  that  can  be  applied  by  managers  of 
water  companies.  The  first  method  consisted  of  semi-structured 
interviews  with  managers  of  the  water  company.  The  second  con¬ 
sisted  of  a  survey  conducted  by  e-mail  with  the  managers  of  the 
environmental  industry.  The  model  suggested  that  there  was  a  need 
to  investigate  the  link  between  environmental  issues,  environmen¬ 
tal  management  systems  and  the  development  of  indicators,  types 
of  goals  and  objectives,  and  management  style  and  the  use  of  indica¬ 
tors  as  a  tool  for  public  relations.  Henri  and  Journeault  [8]  mention 
the  importance  of  the  following:  measuring  environmental  perfor¬ 
mance  through  the  use  of  environmental  performance  indicators 
to  support  organizations  in  communicating  environmental  strate¬ 
gies,  supporting  and  ensuring  Environmental  Compliance,  assisting 
in  obtaining  and  maintaining  ISO  14001  certification,  adopting 
formally  complex  environmental  processes  and  procedures  and 
providing  data  for  external  reporting  in  manufacturing  companies 
in  Canada.  BertrandKrajewski  et  al.  [21]  conducted  an  assessment 
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of  uncertainties  with  regard  to  performance  indicators,  through 
two  case  studies  into  stormwater  facilities.  Both  cases  show  that 
the  uncertainties  are  very  significant  and  should  be  included  in  the 
calculation  and  use  of  performance  indicators.  These  researchers 
point  out  that  there  has  been  little  research  into  the  use  of  envi¬ 
ronmental  performance  indicators  for  decision-making  which  are 
based  on  the  quality  of  the  raw  data. 

4.  Importance  of  indicators  as  a  tool  for  decision-making 

According  to  Andrade  [34],  one  of  the  factors  that  can  complicate 
rational  decision-making  is  uncertainty.  Most  decisions,  particu¬ 
larly  the  most  important,  are  made  on  the  basis  of  some  kind  of 
prediction,  which,  in  itself,  puts  the  uncertainty  factor  into  the  deci¬ 
sion  process.  Even  if  the  problem  does  not  require  any  evaluation 
to  be  made,  another  complicating  factor  is  the  lack  of  information. 
Thus  one  of  the  main  difficulties  encountered  by  decision-makers 
in  companies  -  such  as  questions  concerning  how  to  invest  and 
why,  how  to  prioritize  and  what  the  returns  on  investments  in  the 
environment  should  be  -  is  the  lack  of  knowledge  and  information 
available  for  dealing  with  complex  issues.  Olsthoorn  et  al.  [  1 2  ]  argue 
that  decision-making  and  the  management  of  complex  issues  in  the 
industrial  environment,  requires  the  use  of  indicators  to  represent 
what  these  issues  are.  Thoresen  [14]  states  that  in  practice  environ¬ 
mental  performance  indicators  can  be  used  for  decision-making  by 
interested  parties,  both  outside  the  organization  (at  a  macro  level) 
and  at  different  levels  of  organization  within  the  company  (at  a 
micro  level)  and  that  this  can  gradually  reduce  the  harmful  environ¬ 
mental  impacts  of  products  and  processes.  External  stakeholders 
need  a  set  of  environmental  performance  indicators  (applied  on 
a  large  scale)  to  enable  them  to  exert  pressure  on  businesses  and 
thus  ensure  that  improvements  are  planned  and  implemented  on 
an  ongoing  basis.  Berkhout  et  al.  [6]  argues  that  environmental  per¬ 
formance  indicators  can  be  used  by  stakeholders  in  business  in  the 
following  ways: 

•  Banks  and  insurers  can  examine  the  environmental  performance 
indicators  to  assist  companies  in  evaluating  long-term  economic 
risks. 

•  Fund  managers  use  environmental  criteria  to  address  demands 
for  the  incorporation  of  environmental  concerns  and  ethical 
issues  in  investment  decisions. 

•  Those  responsible  for  policymaking  can  evaluate  the  effective¬ 
ness  of  different  policy  devices  in  improving  the  environmental 
performance  of  companies. 

•  Researchers  can  analyze  the  design  and  trends  to  improve  our 
understanding  of  the  causes  of  high  and  low  environmental  per¬ 
formance. 

5.  Quality  of  raw  data  to  construct  indicators 

According  to  BertrandKrajewski  et  al.  [21],  only  a  few  studies 
about  performance  indicators  address  the  following  issues: 

•  Evaluation  of  the  quality  and  the  credibility  of  results  obtained 
through  an  estimation  of  performance  indicators. 

•  Evaluation  of  the  impact  of  the  quality  of  the  indicators  on  deci¬ 
sions  that  have  to  be  made. 

Nordheim  and  Barrasso  [18]  and  Von  Bahr  et  al.  [32]  assess 
the  importance  of  data  quality  indicators  to  measure  the  operat¬ 
ing  performance  for  three  types  of  emissions,  dust,  NO*  and  SO2 
as  a  limiting  factor  for  benchmarking  and  to  carry  out  an  external 
evaluation  of  six  cement  plants  in  Sweden,  Norway  and  Finland.  The 
author  highlights  the  importance  of  the  need  to  take  into  account 


the  reliability,  availability  and  ability  to  validate  the  scientific  and 
statistical  data  when  comparing  the  environmental  performance  of 
two  companies. 

Perotto  et  al.  [19]  state  that  measuring  the  organization’s  envi¬ 
ronmental  performance  remains  one  of  the  great  difficulties  for  the 
organization  and  certification/bodies  responsible.  The  question  of 
the  link  between  measurement  uncertainty  and  the  indicator  can 
be  a  competitive  differentiator,  because  the  environmental  perfor¬ 
mance  indicators  are  used  by  companies  for  benchmarking  which 
means  that  environmental  performance  indicators  which  have  a 
lower  degree  of  uncertainty  will  inspire  greater  confidence  among 
the  stakeholders.  When  there  is  a  maximum  or  minimum  level 
for  the  indicator,  whether  established  by  legislation  or  otherwise, 
the  degree  of  uncertainty  becomes  an  essential  factor  in  assessing 
the  likelihood  of  error  or  accuracy  in  decision-making.  The  uncer¬ 
tainty  of  the  indicator  is  also  a  valuable  tool  to  use  to  allow  the  key 
components  that  influence  the  final  quality  of  the  indicators  to  be 
identified.  On  the  other  hand,  if  the  degree  of  uncertainty  of  the 
indicator  is  unknown,  a  change  in  its  value  may  be  due  to  natural 
variability  in  the  process  of  planning  and  implementing  changes 
and  this  can  increase  the  probability  of  making  wrong  decisions. 


6.  Measurement  uncertainty 

The  term  uncertainty  is  closely  linked  to  the  concept  of  doubt. 
The  uncertainty  of  the  measurement  is  nothing  more  than  a  doubt 
regarding  the  measurand  (a  particular  quantity  that  is  subject  to 
measurement)  at  the  time  when  the  measurement  is  carried  out. 
Uncertainty  can  be  understood  as  a  measure  of  quality  measure¬ 
ment  [35].  Thus,  it  can  be  said  that  the  smaller  the  uncertainty, 
the  better  the  quality  of  the  measurement.  It  is  evident  that  the 
measurement  result  is  the  best  evaluation  of  the  measurand,  and 
that  all  the  components  of  uncertainty,  including  those  arising  from 
systematic  effects,  such  as  components  associated  with  corrections 
and  reference  standards,  contribute  to  the  dispersion. 

The  uncertainty  of  the  result  of  a  measurement  reflects  the  lack 
of  a  complete  knowledge  of  the  value  of  the  measurand.  The  result 
of  a  measurement  after  correction  of  the  known  systematic  effects, 
is  still  only  an  evaluation  of  the  value  of  the  measurand  because 
of  uncertainty  arising  from  the  extent  of  random  effects  and  the 
imperfect  correction  of  the  result  of  systematic  effects,  both  of 
which  can  never  be  fully  known.  Therefore,  the  result  of  measur¬ 
ing  or  calculating  a  magnitude  represents  only  an  approximation  of 
the  value  of  the  measurand  and  to  be  complete  it  must  be  accom¬ 
panied  by  a  statement  of  measurement  uncertainty.  According  to 
the  International  Vocabulary  of  Basic  and  General  Terms  in  Metrol¬ 
ogy  VIM  [36],  the  uncertainty  of  measurement  generally  comprises 
many  components.  Some  of  these  components  can  be  evaluated  on 
the  basis  of  the  statistical  distribution  of  the  results  of  a  series  of 
measurements  and  can  be  characterized  by  experimental  standard 
deviations.  The  other  components,  which  can  also  be  characterized 
by  standard  deviations,  are  evaluated  by  the  assumed  probability 
distribution,  based  on  experience  or  other  information.  To  avoid 
the  occurrence  of  duplications  of  the  uncertainties  associated  with 
measuring,  it  is  necessary  to  adopt  a  structured  and  detailed  pro¬ 
cedure.  VIM  recommends  the  use  of  the  cause  and  effect  diagram, 
also  known  as  the  Ishikawa  diagram,  to  achieve  this  goal. 

Several  methods  have  been  used  to  determine  the  measurement 
uncertainty.  One  method  that  is  widely  accepted  by  accredita¬ 
tion  bodies,  is  GUM  which  lays  down  general  rules  that  must  be 
adhered  to  by  metrologists  involved  in  quality  measurement  from 
the  shop  floor  to  in-depth  research,  to  evaluated  the  measurement 
uncertainty  of  the  measurand.  In  addition,  GUM  sets  out  a  proce¬ 
dure,  which  is  widely  believed  to  propagate  uncertainties  in  inputs 
(measured  variables)  for  the  output  quantities  (variables  that  are 
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calculated  through  a  model).  The  measure  is  generally  straight¬ 
forward  in  evaluating  the  indicator  when  it  is  absolute,  and  the 
uncertainty  of  the  input  is  the  very  uncertainty  of  the  indicator. 
On  the  other  hand,  when  these  are  indicators  of  two  or  more  input 
quantities,  they  are  measured  directly  and  their  uncertainties  must 
be  propagated  to  the  output  quantity;  in  other  words,  the  uncer¬ 
tainty  of  the  relative  indicator  always  of  the  in  the  form  of  the 
composition  of  the  uncertainties  of  the  input. 

6.3.  Evaluating  standard  uncertainty 

When  evaluating  the  measurement  uncertainty,  GUM  reflects 
the  propagation  of  the  uncertainties  of  the  influence  quantities 
through  a  mathematical  model  that  represents  the  measurand: 

Y=f(X  UX2,...,XN)  (1) 

where  Y  represents  the  output  quantity  and  Xt  the  input  quan¬ 
tities.  Each  input  evaluated  and  its  associated  combined  standard 
uncertainty  are  obtained  from  a  distribution  of  possible  values  of 
the  input  quantities.  This  probability  distribution  can  be  based  on 
the  frequency,  that  is,  a  series  of  observations,  or  may  be  an  a  pri¬ 
ori  distribution.  Uncertainties  called  Type  A  are  calculated  from  a 
series  of  independent  repeated  observations  and  is  the  familiar  sta¬ 
tistically  evaluated  experimental  standard  deviation  of  the  mean, 
while  the  uncertainties  called  Type  B,  are  obtained  by  means  of  a 
series  of  observations  other  than  statistical  analysis,  in  other  words, 
is  obtained  from  an  assumed  probability  density  function  based  on 
the  degree  of  belief  that  an  event  will  occur. 


6.3.3.  Type  A  standard  uncertainty 

The  uncertainty  of  Type  A  is  evaluated  on  the  basis  of  the 
randomness  of  the  sample  values.  Where  possible  sources  of  ran¬ 
domness  originate  from  human  actions,  the  environment  and 
process  itself  on  the  measurement  system.  Hence,  a  good  evalu¬ 
ation  for  this  type  of  uncertainty  is  provided  by  the  experimental 
standard  deviation  of  the  mean,  which  can  be  represented  by  Eq. 
(2). 


uA  = 


—  S-- 
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n-  1  \ 


k= 1 


n  —  3 ' 
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(2) 


where  Sq  characterizes  the  dispersion  of  the  results,  qk  represents 
the  result  of  the  k  th  measurement  and  q  represents  the  arithmetic 
mean  of  n  results  considered.  The  term  before  Sq  is  the  correction 
of  Bayes,  according  to  Kacker  et  al.  [37] 


6.3.2.  Type  B  standard  uncertainty 

Beyond  the  intrinsic  variability  of  the  measurand,  there  is  the 
variability  that  is  added  by  the  measurement  system.  It  is  desirable 
that  the  measurement  systems  have  the  smallest  possible,  i.e.  negli¬ 
gible,  effect  on  the  measurand,  although  it  is  necessary  to  evaluate 
this  component  of  uncertainty  before  stating  that  it  is  negligible. 
This  component  of  uncertainty  is  called  GUM  uncertainty  Type  B. 
The  Type  B  evaluation  of  uncertainty  uses  means  other  than  the 
static  analysis  of  a  series  of  repeated  measurements  at  the  time  of 
the  test.  According  to  GUM,  the  proper  use  of  all  available  informa¬ 
tion  for  a  Type  B  evaluation  of  standard  uncertainty  can  be  obtained 
through  the  following:  experience  and  knowledge,  which  can  be 
achieved  from  practice,  performance  measurement  based  on  the 
historical  data  method,  uncertainties  inherited  from  the  calibra¬ 
tion  equipment  and  standards,  and  the  range  of  environmental 
conditions,  among  others. 

The  most  direct,  though  not  necessarily  the  cheapest,  way  to 
evaluate  uncertainty  Type  B,  is  available  when  there  is  a  calibra¬ 


tion  certificate  of  the  measuring  system.  Ideally,  this  certificate 
should  be  issued  by  conducting  experiments  with  instruments  on 
the  premises,  which  means  that  if  you  use  a  flow  meter  attached 
to  an  industrial  chain,  the  calibration  of  the  instrument  should  be 
performed  in  an  operation  on  the  factory  floor  during  the  manu¬ 
facturing  process. 


6.3.3.  Combined  standard  uncertainty 

The  effects  of  the  combined  action  of  several  sources  of  uncer¬ 
tainty  should  be  quantified  by  the  combined  uncertainty  [38,37]. 
GUM  is  employed  to  propagate  the  estimates,  standard  uncertain¬ 
ties  and  correlation  coefficients  of  input  quantities  from  a  linear 
approximation  of  the  model  that  links  the  quantities  input  with 
the  output,  using  the  Taylor  series  around  their  averages.  The 
combined  standard  uncertainty  considering  all  of  the  independent 
input  quantities  is  given  by: 


u2ciy)  =  Y 

1=1 


(3) 


where,  3//3x;  is  the  sensitivity  coefficients,  and  describes  how  the 
output  estimate  y  varies  with  changes  in  the  values  of  the  input 

estimates  X\,X2 . xjv-  Each  is  a  standard  uncertainty  evaluated  as 

described  in  Section  6.1.1  (Type  A  evaluation)  or  as  in  Section  6.1.2 
(Type  B  evaluation).  When  Eq.  (3 )  is  used  to  evaluate  the  uncertainty 
of  a  quantity  measured  directly,  it  takes  the  following  form: 


u2{xi)  = 
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(4) 


The  estimated  input  xi,  X2 . xjv  which  makes  a  greater  contri¬ 

bution  to  the  value  of  the  measurand  will  have  the  highest  level 
of  contribution,  and  therefore  makes  a  greater  contribution  to  the 
final  uncertainty  of  y.  For  a  comparison  of  the  contribution  of  the 
uncertainties  of  the  input  variables,  it  is  necessary  to  express  the 
coefficient  of  contribution  h(y,  x,)  on  a  relative  scale  (%)  for  com¬ 
bined  standard  uncertainty.  Kessel  et  al.  [39]  set  out  the  following 
expression  as  a  factor  contributing  to  the  uncorrelated  input  vari¬ 
ables: 


fi(y,x,)  = 
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6.2.  Expanded  uncertainty 

The  expanded  uncertainty  is  the  range  around  the  measurement 
result  which  covers  a  large  proportion  of  the  probability  distribu¬ 
tion,  characterized  by  that  result  and  its  combined  uncertainty.  The 
expanded  uncertainty  U  is  obtained  by  multiplying  the  combined 
standard  uncertainty  uc(y)  by  a  coverage  factor  k. 


U  =  k  •  uc(y) 


(6) 


The  result  of  a  measurement  is  then  expressed  as  Y=y  ±  U,  where 
Y  is  the  value  assigned  to  the  measurand,  and  y  +  Uay-Uis  the 
interval  that  is  expected  to  cover  a  large  fraction  of  the  distribution 
of  values  that  can  be  attributed  to  Y.  The  coverage  factor  must  be 
calculated  from  the  values  of  the  number  of  degrees  of  freedom 
and  the  standard  uncertainty  of  each  source  of  uncertainty  in  Eq. 
(7)  Welch-Satterthwaite(W-S). 
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Component  of  the  El 

Fig.  1.  Coefficient  of  the  contribution  of  the  major  component  of  El. 


where  vef{  is  the  effective  degree  of  freedom,  uc(y)  is  the  combined 
uncertainty,  u(xt)  is  standard  uncertainty  associated  with  the  ith 
source  of  uncertainty,  vt  is  the  number  of  degrees  of  freedom  asso¬ 
ciated  with  the  ith  source  of  uncertainty  and  N  the  total  number  of 
sources  of  uncertainties  analyzed. 

The  W-S  formula  provides  an  approximate  solution  to  the  prob¬ 
lem  of  determining  the  confidence  interval  for  the  measurand. 
Using  the  formula  in  determining  the  W-S,  veff  the  coverage  fac¬ 
tor  k  can  be  evaluated  by  a  Student’s  t-distribution.  The  coverage 
factor  not  only  depends  on  k{ve ff,  p),  but  also  the  confidence  level 
(probability  of  coverage)  p  desired  in  the  analysis  of  the  expanded 
uncertainty.  Thus,  the  coverage  factor  is  called  k(ve ff,  p)  and  the 
expanded  uncertainty  is  expressed  by  U  =  kpuc.  The  value  of  k  is  sim¬ 
ilar  to  the  tabulated  values  of  Student's  t-distribution  with  effective 
degrees  of  freedom  for  a  given  level  of  confidence.  The  W-S  formula 
depends  on  several  hypotheses  to  be  strictly  valid:  all  the  quantities 
must  have  normal  PDF,  all  the  input  quantities  must  be  indepen¬ 
dent  and  the  linear  approximation  model  of  the  measurand  must 
also  be  appropriate  ([22],  clause  5.1.2  and  5.1.5).  However,  in  most 
cases  these  assumptions  are  not  fully  met  see  Martins  et  al.  [40] 
who  outline  a  number  of  appropriate  treatment  alternatives  for 
these  situations.  When  the  indicator  is  represented  by  a  non-linear 
model  or  when  the  assumptions  referred  to  above  are  not  appro¬ 
priate,  the  application  of  the  technique  of  Monte  Carlo  simulation, 
described  in  the  GUM  Supplement  1  and  developed  by  B1PM  et  al. 
[41]  and  Martin  et  al.  [40]  is  recommended. 

7.  Case  study 

The  monitoring  process  in  petrochemical  industries  is  under¬ 
taken  through  the  use  of  indicators  calculated  over  periods  of  time 
and  drawing  on  data  from  the  process.  The  indicators  show  the 
times  when  the  operation  took  place  in  a  stable  way  and  in  times 
of  highly  variable  production. 

In  this  study  a  method  is  used  to  evaluate  the  uncertainty  of 
the  energy  indicator  at  a  petrochemical  unit.  This  energy  indica¬ 
tor  represents  the  amount  of  energy  consumed  in  the  production 
process.  The  goal  of  the  company  is  to  reduce  the  rate  by  3%,  with 
investment  being  made  in  projects  and  personnel.  A  reduction  in 
this  indicator  can  mean  lower  fuel  consumption,  less  C02  pollution 
and  a  fall  in  production  costs.  Validation  is  an  important  stage  in 
the  evaluation  of  this  indicator  and  it  is  necessary  to  calculate  the 
uncertainty  to  ensure  that  3%  represents  a  significant  reduction  in 
fuel  and  production  costs.  We  provide  an  estimate  of  evaluate  the 


uncertainty  of  the  energy  indicator  and  its  sensitivity  to  changes  in 
the  operation  process.  The  structure  of  the  indicator  was  displayed 
in  a  spreadsheet  to  help  evaluate  the  uncertainty  of  the  indicator 
as  well  as  its  sensitivity  to  each  of  the  components  of  the  model. 

7.2.  Energy  indicator 

The  energy  indicator  (£/)  has  been  used  to  monitor  the  energy 
consumption  relative  to  the  rate  of  production  in  the  period.  The 
study  of  uncertainty  arose  from  the  need  to  optimize  the  produc¬ 
tion  of  inputs,  with  regard  to  reducing  energy  consumption  for  a 
possible  operating  point  and  has  achieved  real  results.  According 
to  ISO  1 403 1 ,  El  can  be  categorized  as  an  indicator  of  operating  per¬ 
formance  and  classified  as  an  aggregate,  composed  of  the  sum  of 
17  components  in  the  numerator  (C2V)  with  27  components  in  the 
denominator  (CD)  of  various  sources  (Eq.  (8)). 

17 


27  v  ' 

X> 

1=1 

The  main  feature  of  the  components  of  the  numerator  is  that  it 
should  be  used  in  the  generation  or  transmission  of  energy  entering 
the  volume  control  of  the  company,  since  the  denominator  refers 
to  the  products  that  are  stocked  or  sold.  Each  component  is  the  sum 
of  the  value  from  thee  measuring  device  that  monitors  the  stream 
in  real  time,  Fig.  2. 

7.2.  Applying  the  GUM  methodology 

The  procedure  used  to  evaluate  the  uncertainty  followed  the 
recommendations  of  GUM,  as  described  in  Section  6.  The  evaluate 
of  uncertainty  was  based  on  the  method  for  propagation  of  uncer¬ 
tainties  of  input  quantities  (C2V  and  CD)  for  the  magnitude  of  output 
(El).  In  each  quantity,  the  input  was  regarded  as  comprising  the 
contributions  of  Type  A  (Eq.  (2))  and  Type  B  uncertainties,  where 
the  former  concerns  process  variability  and  the  latter  the  quality  of 
measurement. 

After  identifying  the  model  (Eq.  (8)),  we  adopted  a  procedure 
to  evaluate  the  sources  of  uncertainty,  as  well  as  the  Type  A  and 
Type  B  uncertainties.  The  uncertainty  is  dependent  on  the  behav- 
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Table  2 

Source  of  measurement  uncertainty  and  uncertainty  values  Type  B. 


Source  of  uncertainty 

Uncertainty  (%) 

Orifice  plate 

3.50 

Measure  mass 

0.80 

Orifice  plate  4  holes 

2.00 

Tank 

0.20 

Gases 

1.00 

Liquid 

0.70 

Steam 

2.00 

Eletricity  input 

1.00 

Eletricity  output 

1.00 

Table  3 

Estimation  of  uncertainty  of  Type  A  gas  fuel. 


Daily  production  of  gas  fuel  (kg/day)  50.9E+05 

The  mean  of  the  uncertainties  Type  A  (kg/day)  50.9E+04 

Combined  uncertainty  of  fuel  gas  produced  (kg/day)  1.0E+05 

Coefficient  of  variation  of  the  combined  uncertainty  of  the  2.0 

fuel  gas  or  relative  uncertainty  (%) 


ior  of  industrial  production  and  will  thus  fluctuate  over  a  period  of 
time.  Therefore  of  this,  we  chose  a  fixed  day  which  the  engineering 
dept  regarded  as  suitable  for  providing  stable  conditions.  An  elec¬ 
tronic  spreadsheet  was  prepared  to  allow  some  future  changes  in 
the  variable  values  used  in  this  research. 

The  Type  A  uncertainties  of  CN  and  CD  should  be 
obtained  by  analyzing  the  data  by  means  of  a  measure¬ 
ment  device  used  in  the  operating  process.  Nevertheless, 
there  are  more  than  1000  measurement  devices  which 
means  that  conducting  an  analysis  of  all  the  measurement 
devices  in  industry  would  be  an  arduous  task.  In  view  of  this 
,  we  conducted  an  accurate  analysis  of  the  most  important  compo¬ 
nent  and  we  treated  the  uncertainty  of  Type  A  of  the  measurement 
devices  of  the  other  components  as  the  mean  of  the  uncertainty 
of  the  important  component.  The  most  important  component  is 
fuel  gas  which  makes  up  70  %  of  all  the  energy  consumed  in  the 
industry.  The  contribution  of  the  indicator  for  each  components  is 
represented  by  the  coefficient  of  the  contribution  [40]  (Fig.  1 ). 

It  is  important  to  bear  in  mind  that  the  structure  of  the  indicator 
is  the  most  important  part  at  this  stage  because  it  allows  changes  to 
be  made  in  the  values  when  doubt  exists.  The  Type  A  uncertainties 
were  evaluated  with  the  aid  of  Eq.  (2)  and  the  data  were  measured 
each  second. 

The  analysis  of  Type  B  uncertainties  is  used  to  find  out  about 
the  measuring  device  used  in  the  measurement.  We  analyzed  the 
measuring  devices  and  a  table  was  prepared  to  show  the  typi¬ 
cal  uncertainties  that  are  caused  by  the  petrochemical  industry  in 
question.  This  Table  is  already  being  used  in  the  data  reconciliation 
and  on-line  process  optimization  of  the  industry.  Table  2  displays 
the  sources  and  their  related  uncertainties.  The  uncertainty  values 
of  the  orifice  plate  meter  and  mass  were  evaluated  on  the  basis 
of  the  average  values  found  in  the  internal  research  (reports  of  the 
operation).  The  uncertainty  values  of  inputs  coming  from  the  tanks, 
gas,  liquid,  steam  sales,  electrical  supplies  were  drawn  from  the 
monthly  reports. 

All  these  factors  were  evaluated  through  the  combined  standard 
uncertainty  (Eq.  (3))  of  CN  and  CD,  and  took  account  of  all  the  input 
variables  of  the  independent  model  (Eq.  (8)).  The  degree  of  free¬ 
dom  is  calculated  using  the  Welch-Satterthwaite  equation  (Eq.  (7)), 
which  treats  the  probability  density  functions  of  the  components 
of  the  numerator  and  denominator  as  normal  and  independent. 

The  analysis  of  the  Type  A  uncertainties  of  the  fuel  gas  is 
achieved  by  identifying  all  the  fuel  gas  meters  and  the  information 
flow  values  collected  by  the  company.  Table  3  shows  the  estimate 
of  Type  A  uncertainty  for  the  fuel  gas. 


The  evaluated  of  the  uncertainty  of  the  indicator  of  energy 
consumption  per  ton  of  petrochemicals  produced  is  based  on  the 
contribution  of  process  variability  (uncertainty  Type  A)  and  quality 
measurement  (uncertainties  Type  B).  From  the  data  obtained,  we 
also  raised  the  degree  of  freedom,  considering  30  measurements 
for  each  meter,  thus  implying  a  degree  of  freedom  of  29.  By  apply¬ 
ing  the  Welch-Satterthwaite  formula  (Eq.  (8)),  we  calculated  the 
degree  of  freedom  of  each  component  and  then  the  overall  indica¬ 
tor,  and  obtained  a  value  of  333  for  the  degree  of  freedom.  With  the 
degree  of  freedom  at  a  confidence  level  of  90%  a  coverage  factor  of 
2  was  obtained.  In  this  context,  due  to  poor  knowledge  about  the 
uncertainties,  several  scenarios  arose  ranging  from  the  uncertain¬ 
ties  Types  A  and  B  for  the  input  quantity,  and  seven  possibilities 
were  obtained  which  are  displayed  in  Table  4. 

From  Table  4  it  can  be  observed  that,  if  scenario  1  is  adopted, 
the  energy  indicator  can  be  shown  as: 

El  =  (20.0  ±0.2)5!  (9) 

where  the  number  following  the  symbol  ±  is  the  numerical  value 
of  U=  k  ■  uc,  an  expanded  uncertainty,  with  U  given  by  uc  =  0.1  CJ/t,  a 
combined  standard  uncertainty  and  a  coverage  factor  k  =  1 .67  based 
on  the  f-distribution  for  veff  =  69  degrees  of  freedom.  U  defines  an 
interval  evaluated  to  have  a  90%  confidence  interval. 

Alternatively,  if  scenario  7  is  adopted,  the  energy  indicator  can 
be  shown  as: 

El  =  (20.0  ±  0.8)  y  (10) 

where  uc  changes  to  0.5  GJ /t  and  k  to  1 .65  based  on  the  f-distribution 
for  veff  =  361  degrees  of  freedom  for  the  same  90%  confidence  inter¬ 
val. 

Fig.  2  shows  the  main  components  that  contribute  to  a  quanti¬ 
tative  calculation  of  the  IE  and  thus  influence  the  final  uncertainty 
of  the  indicator.  A  sensitivity  test  of  the  indicator  based  on  Eq.  (5) 
shows  that  the  component  of  the  calculation  that  most  influences 
the  final  value  of  uncertainty  is  the  fuel  gas.  This  means  that  it  is 
these  meters  that  most  need  to  be  improved  so  that  the  uncertainty 
indicator  can  be  significantly  reduced. 

The  process  of  estimating  the  uncertainty  was  influenced  by  the 
method  of  calculating  the  daily  flow.  Before  the  system  was  imple¬ 
mented  for  the  reconciliation  of  the  corporate  data,  this  calculation 
was  based  on  information  that  had  been  memorized  throughout  the 
day.  After  the  implementation  of  the  reconciler,  this  information 
was  collected  every  minute,  and  after  this  its  value  was  calculated 
on  the  basis  of  the  number  of  minutes  of  the  day.  These  two  proce¬ 
dures  were  tested  in  the  evaluated  daily  flow  rate  of  a  variable  and 
little  difference  was  observed  between  the  two  forms  of  calculation. 

The  chart  above  (Fig.  2)  shows  the  values  measured  minute  by 
minute  and  the  mean  throughout  the  day  (black  horizontal  line). 
Using  the  first  calculation  (information  that  had  been  memorized 
throughout  the  day),  the  value  at  the  end  of  the  day  of  production 
is  calculated  by  integrating  the  area  within  the  curve  of  the  flow 
of  fuel  gas;  this  would  be  the  measurement  of  the  total  amount 
in  the  second  format  of  the  calculation  (after  the  implementation 
of  the  reconciler)  which  is  obtained  through  the  mean  daily  flow 
rate  and  then  multiplied  by  the  time  interval  required  for  collecting 
information.  The  sum  of  the  area  is  shown  below  the  black  line.  The 
results  of  both  procedures  are  described  in  Table  5. 

This  result  shows  that  the  two  ways  of  calculating  the  daily  flow 
are  very  close.  The  same  procedure  was  adopted  in  this  paper  as 
was  used  in  the  reconciliation  of  data  -  the  daily  flow  from  the 
multiplication  of  the  average  flow  time  interval  of  interest. 

In  discussions  with  the  engineering  team  (operational,  moni¬ 
toring  and  instrumental)  a  consensus  was  reached  that  the  most 
realistic  and  safest  scenario  is  the  7,  which  means  that  the  uncer¬ 
tainty  that  the  company  adopted  for  the  energy  indicator  was 


Table  4 

Scenarios  for  estimating  uncertainty  of  El. 
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Source  of  uncertainty 

Scenarios 

1 

2 

3 

4 

5 

6 

7 

Orifice  plate  (Type  B) 

3.5% 

3.5% 

3.5% 

7.0% 

7.0% 

7.0% 

7.0% 

Mass  (Type  B) 

0.8% 

0.8% 

0.8% 

1.6% 

1.6% 

1.6% 

1.6% 

Orifice  plate  4  holes  (Type  B) 

2.0% 

2.0% 

2.0% 

4.0% 

4.0% 

4.0% 

4.0% 

Tank (Type  B) 

0.2% 

0.2% 

0.2% 

0.4% 

0.4% 

0.4% 

0.4% 

Gas  (Type  B) 

1.0% 

1.0% 

1.0% 

2.0% 

2.0% 

2.0% 

2.0% 

Liquid  (Type  B) 

0.7% 

0.7% 

0.7% 

1.4% 

1.4% 

1.4% 

1.4% 

Steam  (Type  B) 

2.0% 

2.0% 

2.0% 

4.0% 

4.0% 

4.0% 

4.0% 

Electricity  (input)  (Type  B) 

1.0% 

1.0% 

1.0% 

2.0% 

2.0% 

2.0% 

2.0% 

Electricity  (output)  (Type  B) 

1.0% 

1.0% 

1.0% 

2.0% 

2.0% 

2.0% 

2.0% 

Uncertainty  of  fuel  gas  (Type  B) 

3.5% 

3.5% 

7.0% 

7.0% 

7.0% 

7.0% 

7.0% 

Type  A  uncertainty  of  all  variables 

1.0% 

2.0% 

1.0% 

1.0% 

2.0% 

4.0% 

10.0% 

Expanded  uncertainty  of  the  energy  indicator  (%) 

1% 

1% 

1% 

1% 

2% 

2% 

4% 

Expanded  uncertainty  of  the  energy  indicator  (GJ/t) 

0.2 

0.2 

0.2 

0.3 

0.3 

0.4 

0.8 

Value  of  the  energy  indicator  (GJ/t) 

20.0 

Note  1 :  Scenario  1  -  Type  B  uncertainty  as  used  in  the  reconciliation  of  balance  sheet  data  of  hydrocarbons. 

Note  2:  Scenario  2  -  Type  A  uncertainty  double  uncertainty  Type  A  of  the  scenario  1. 

Note  3:  Scenario  3  -  Type  B  uncertainty  of  the  fuel  gas  twice  the  uncertainty  Type  B  gas  fuel  of  the  scenario  1. 

Note  4:  Scenario  4  -  Type  B  uncertainties  of  all  the  instruments  twice  the  uncertainty  Type  B  of  the  scenario  1. 

Note  5:  Scenario  5  -  Type  B  uncertainties  of  all  instruments  and  uncertainty  of  Type  A  double  uncertainty  Type  B  and  Type  A,  respectively,  of  the  scenario  1. 

Note  6:  Scenario  6  -  Type  B  uncertainties  of  all  the  instruments  double  the  Type  B  uncertainty  and  Type  A  uncertainty  quadruple  the  uncertainty  of  Type  A  of  the  scenario  1. 
Note  7:  Scenario  7  -  MORE  LIKELY  SCENARIO  -  Type  B  uncertainties  of  all  the  instruments  twice  the  uncertainty  Type  B  and  type  the  uncertainty  Type  A  is  the  uncertainties 
fuel  gas  type. 
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Fig.  2.  Chart  with  the  measures  minute  to  the  minute  of  the  gas  fuel. 


Table  5 

Calculation  of  averages  by  two  procedures. 

Mean  flow  (kg/min)  0.09972 

Time  interval  (min)  1441 

Daily  flow  using  the  mean  rate  multiplied  by  the  time  interval  143.7018 
(kg/day) 

Daily  flow  by  the  direct  sum  of  the  flows  minute  by  minute  143.4032 

(kg/day) 


(20.0  ±  0.8)  GJ/t,  or  in  other  words,  4%  of  the  measured  value.  This 
result  has  changed  the  way  the  company  sets  its  goals  for  improv¬ 
ing  efficiency,  because  it  was  found  that  whether  or  not  these  goals 
could  be  met,  merely  depends  on  the  variability  of  the  process 
because  they  were  within  the  range  of  uncertainty  of  the  indicator. 

8.  Conclusions 

The  evaluation  of  data  quality  for  obtaining  the  kind  of  environ¬ 
mental  indicators  that  are  most  appropriate  for  a  given  process  is 
one  of  the  most  important  stages  in  the  correct  interpretation  of  an 
indicator  of  environmental  or  operational  efficiency. 

The  methodology  based  on  GUM  offered  here  for  the  evaluation 
and  assessment  of  uncertainty  when  applied  to  a  power  indica¬ 


tor  at  a  petrochemical  company,  has  led  us  to  reach  the  following 
conclusions: 


•  It  can  be  assumed  that  the  most  likely  7°  scenario  is  4%  of  the 
value  of  the  indicator  or  0.8  GJ/t,  based  on  calculations  made  in 
January  2008  and  that  it  had  an  El  of  20.0  GJ/t. 

•  The  most  important  component  in  estimating  the  uncertainty  of 
the  indicator  is  the  flow  of  the  fuel  gas. 

•  It  is  important  to  raise  measurements  involving  the  variability 
of  the  process  because,  in  addition  to  improving  the  value  of  the 
indicator,  it  can  help  to  lower  the  uncertainty  of  this  indicator. 

In  general,  when  evaluating  the  performance  of  an  organization 
through  indicators,  a  tool  used  for  decision-making  must  take  into 
account  their  uncertainty,  even  in  an  industrial  environment  where 
there  is  variability  in  the  process.  Hence,  it  is  essential  to  obtain  the 
knowledge  of  how  the  indicator  is  constructed  and  to  be  aware  of 
its  limitations  in  measuring  the  quality  of  each  of  its  components. 
In  other  words,  it  is  essential  to  evaluated  the  uncertainty  of  each 
component  of  the  indicator  and  the  propagation  of  the  uncertainty 
of  the  indicator  itself. 
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The  case  study  was  undertaken  in  an  industrial  environment 
which  is  reasonably  under  control  and  subject  to  less  variability 
than  in  other  media.  This  shows  that  the  uncertainty  of  the  indicator 
is  significant  and  should  not  be  assumed  to  be  negligible.  In  other 
environments,  where  the  operational  conditions  or  environment 
cannot  be  controlled  or  known,  the  indicators,  be  they  relative  or 
absolute,  should  have  an  even  greater  uncertainty.  In  view  of  this,  it 
is  recommended  that  the  uncertainty  of  the  indicators  be  evaluated 
in  any  situation  or  the  wrong  decisions  may  be  taken. 
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